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In accordance with the present invention, a mobile agent object (10) executes a first method (18) on a first computer (12) migrates 
from the first computer (12) to a second computer (14), and executes a second method (20) on the second ^^l^^ 
second methods and first and second computers are designated in an itinerary (28). The agent .ncludes both data (22) and executable code 
26) whidTare serialized for transmission from the first computer to the second computer as dam The daaconu.njng the agent ,s 
then deserialized in the second computer to regenerate the agent in the form of an object. The executable code port.on of the agent can be 
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TITLE OF THE INVENTION 
ITINERARY BASED AGENT MOBILITY INCLUDING MOBILITY OF 

EXECUTABLE CODE 

CROSS REFERENCE TO RELATED APPLICATIONS 
A claim of priority is made to U.S. provisional patent 
application Serial Number 60/030,906, entitled USE AND 
COLLABORATION OF MOBILE AGENTS IN A COMPUTER NETWORK, filed 
November 14, 1996. 



STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 

DEVELOPMENT 
Not applicable 



BACKGROUND OF THE INVENTION 

The present invention is generally related to network 
computing, and more particularly to mobile objects. 

Mobile objects that are transmitted across a computer 
network are known. Mobile objects are comprised of code and 
data, both of which are transmitted across the computer 
network. Technologies such as client-server protocols, 
remote procedure call protocols, and distributed object 
technologies are employed to transmit mobile objects across 
the computer network. These technologies implement either 
a "push" model or a "pull" model, both of which have 
drawbacks . 

In a "pull" model the code for an executing object is 
downloaded from a network source such as a web server. When 
a particular portion of code becomes necessary for operation, 
that portion of code is first sought on the local filesystem. 
If the local filesystem does not include that portion of the 
code, a network request is sent to another computer in the 
network in order to prompt transmission of that portion of 
code to the local computer. However, as different classes 
of sub- objects are created, a separate network request must 



WO 98/21662 



PCT/US97/20232 



-2 



be sent to retrieve code for each class. In the case of a 
Hyper-Text Transfer Protocol ("HTTP") request, each request 
must re-establish a Transmission Control Protocol /Internet 
Protocol ("TCP/IP") socket connection to the web server. 
Thus, when downloading a large number of classes, a large 
number of connections must be established and a large amount 
of network overhead is incurred. 

Another drawback associated with the pull model is that 
as an object travels, the code which enables the object to 
operate must be re-downloaded at each computer. More 
particularly, when the object arrives at each a destination 
computer, the object downloads any code which is required but 
not present on the local filesystem, even if that code was 
downloaded at the previous destination computer. Previously 
downloaded code is not cached. Network overhead is incurred 

as a consequence. 

in a "push" model the code for an executing ob D ect is 
carried with the mobile object. Prior to launching the 
mobile object, all of the code that will be needed by the 
object is identified. The code is packaged with the agent 
and pushed around the network to each destination computer. 
While the push model reduces network requests in comparison 
with the pull model, network overhead is still incurred 
because of the relatively large amount of code that is pushed 
to every destination computer. In some cases the object will 
push code for classes that are no longer needed. For 
example, an agent may create an instance of a particular 
class of object only in very exceptional circumstances. In 
such a case it is inefficient for the object to push the code 

for this class. 

Another limitation of known mobile objects is difficulty 
in examining and predicting destination information. Known 
mobile objects initiate travel by performing a subroutine 
call The method is sometimes given a name such as "go" or 
"moveTo," and the caller is responsible for specifying a name 
or Uniform Resource Locator ("URL") indicating the 
destination computer for the mobile object. When the travel 
method is called, the execution of the mobile ob D ect is 
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halted and the mobile object is converted into a network 
transmittable form. On the destination computer the mobile 
object is restored from the network form and restarted. This 
restart can either occur on the instruction directly 
following the call to the travel method, or at the beginning 
of some known method. 



BRIEF SUMMARY OF THE INVENTION 
In order to provide efficient mobility of code for a 
mobile agent object ("agent"), a "mobile codebase" object is 
constructed. The mobile codebase travels with the agent and 
serves as a repository of code for classes that facilitate 
agent operation. When the agent is launched, the launcher 
specifies a list of related classes. These classes are 
retained in the mobile codebase. The launcher also specifies 
a Uniform Resource Locator { "URL" ) that points to a network 
source ("home codebase") from which code can be downloaded. 
If the agent is required to instantiate an object comprising 
code that is not in the mobile codebase, a network request 
is sent to the home codebase to retrieve that code. Code 
that is downloaded in this manner is retained in the mobile 
codebase . 

The combination of the mobile codebase and home codebase 
improve agent operation and reduce network overhead. In a 
preferred embodiment an agent is launched with a mobile 
codebase that is preloaded with classes which are certain to 
be needed. Classes that are unlikely to be needed are stored 
in the home codebase. Thus the agent with mobile codebase 
and home codebase provide the desirable features of the push 
and pull models without the undesirable network overhead 
incurred by transmitting unneeded classes around the network 
or re -downloading code. 

Agent travels are defined by an itinerary data 
structure. The itinerary is composed of a list of 
destinations, each of which includes: (1) the hostname of a 
destination computer on the network to which the agent should 
travel, and (2) the name of a method that the agent should 
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execute when the agent arrives at the destination computer. 
An agent is allowed to modify its itinerary. When an agent 
modifies its itinerary, the agent owner is automatically 
notified, thus allowing the owner to "follow" the agent 

wherever it may travel. 

The itinerary provides advantages related to agent and 
network management. Inspection of the agent itinerary 
reveals where the agent has travelled and where the agent may 
travel in the future. Since the itinerary is a standard data 
structure, an observer can depend on it to be present. 
Further, since the itinerary is a separate data structure 
from the agent, the observer does not need special knowledge 
of the internal structure of the agent in order to examine 
the itinerary. 



BRIEF DESCRIPTION OF THE DRAWING 
The invention will be more fully understood from the 

following Detailed Description of the Invention, in 

conjunction with the Drawing, of which: 

Fig. 1 is a block diagram which illustrates agent 

migration; 

Fig. 2 is a block diagram which illustrates agent 
execution in conjunction with agent migration; 
Fig. 3 is a block diagram of an agent; 

Fig. 4 is a block diagram of agent interaction with 
agent managers on multiple computers in a network; 

Fig. 5 is a flow chart which illustrates agent mobility; 

Fig. 6 is a block diagram which illustrates agent 
operation according to an itinerary; 

Fig. 7 is a block diagram which illustrates the agent 

runtime environment; and 

Fig. 8 is a flow chart which illustrates agent 

deserialization. 



DETAILED DESCRIPTION OF THE INVENTION 
Referring to Fig. 1, an agent 10 comprises a mobile 
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object which can travel from a first computer 12 to a second 
computer 14 in a computer network 16. The agent is generated 
and stored in memory on the first computer for a specific 
purpose, and includes both data and executable code. The 
agent executes on the first computer and then migrates to the 
second computer by being transmitted across the network. The 
agent then resumes execution on the second computer. When 
the agent completes execution on the second computer, the 
agent acts in accordance with an agent itinerary. For 
example, the agent will migrate to another computer if the 
itinerary so indicates. 

Referring now to Figs. 1 and 2, the agent executes a 
sequence of instructions during operation. In particular, 
a first method 18 is executed on the first computer 12 and 
a second method 20 is executed on the second computer 14. 
As a result, migration between computers is transparent from 
the perspective of the agent . 

Referring to Fig. 4, agent mobility is preferably 
facilitated through use of JAVA agent manager Objects 32 and 
an Object Serialization facility (a product of Sun 
Microsystems which is known in the art) . Object 
Serialization operates to serialize objects such that a 
representative stream of bytes, i.e., data, is generated 
therefrom. Object Serialization facilitates transmission of 
an agent across the network by serializing the agent 10 into 
a format that is suitable for network transmission. 
Serialization of the agent may also include serialization of 
sub-objects which are contained within member variables of 
the agent. In accordance with the present invention, the 
serialization process involves the serialization of 
executable code, data, and an itinerary as hereinafter 
discussed in greater detail. Once the agent has been 
serialized, a communication socket to the second computer is 
opened and the resulting stream of bytes is transmitted to 
the second computer along the socket. 

The serialized agent is regenerated in the second 
computer 14 upon arrival. In particular, the stream of bytes 
transmitted along the socket is deserialized in the second 
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computer. Deserialization regenerates the agent in the form 
in which the agent existed prior to migration, i.e., an 
object. Following deserialization, the agent executes a 
predetermined method specified by its itinerary. The 
predetermined method may prompt interaction with another 
object 34 located on the second computer. When the method 
has been executed, the agent is serialized and transmitted 
to yet another computer, or possibly back to the first 
computer. The agent is therein deserialized upon arrival and 
proceeds to execute another predetermined method and interact 
with that computer. In the case of the agent migrating back 
to the first computer, such interaction could be with a host 
application 36 through which an information query was 
entered. The agent continues migrating across the network 
in this manner as execution requires. Eventually, the agent 
is terminated when execution of the itinerary is complete. 
It should be noted that the agent need not necessarily 
migrate to the initial host (first) computer after executing 
on a remote (second) computer. The agent could travel to 
multiple computers, and may not return to the initial host 
computer . 

Referring to Fig. 3, each agent may include data 22, 
code 24, sub-objects 26 and an itinerary 28. The data 
portion 22 .includes internal state information associated 
with the agent. The code portion 24 includes executable code 
associated with operation of the agent. The itinerary 
portion 28 specifies destinations for the agent. Sub-objects 
26 include code of distinct objects contained within the 
agent. The agent carries the code for these sub-objects. 

The code 24 portion of the agent 10 includes a mobile 
codebase and a reference pointer to a home codebase. The 
mobile codebase comprises executable code which is retained 
as part of the agent. When the agent migrates, the mobile 
codebase is transmitted along with the data, sub-objects and 
itinerary to the destination. The home codebase is 
executable code which resides on the computer which 
originally created and launched the agent or a suitable 
network server (such as a web server) . The reference pointer 
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to the home codebase is a Uniform Resource Locator ("URL") 
that allows remote access to the home codebase from other 
computers in the network. If the agent requires code that 
is not present in the mobile codebase during execution, the 
agent retrieves the required code from the home codebase and 
retains such retrieved code in the mobile codebase. 

Referring to Figs. 3 and 6, the itinerary 28 is a data 
structure which defines agent migration parameters. The 
itinerary is composed of a list of destinations and the name 
of a method associated with each such destination. In a 
preferred embodiment, each destination entry contains the 
Transmission Control Protocol/Internet Protocol ("TCP/IP") 
host name of a computer on the network to which the agent is 
designated to migrate. The method associated with the 
respective destination is invoked upon arrival at that 
destination. Hence, each destination represents a location 
and a task to be performed at the location. 

Figs. 4 and 5 illustrate agent mobility. When the 
determination is made that the agent should migrate, the 
agent manager 30 examines the itinerary 28 to ascertain the 
next destination to which the agent 10 is designated to 
migrate. The agent manager 30 establishes a network 
connection to the agent manager 32 at the destination 
computer 14. The agent manager 3 0 passes the agent and 
related travel information to the destination agent manager 
32. The agent manager 30 then deletes the local copy of the 
agent, terminates any execution threads which were being used 
by the agent, and performs other appropriate clean up 
activities . 

From the perspective of the destination computer, the 
agent arrives at the destination computer as illustrated in 
step 38. As previously described, the agent arrives in the 
form of data which includes the code, sub-objects, itinerary 
and other data. Java/Object Serialization assists the de- 
serialization and reconstruction of the agent as depicted in 
step 40. The server then spawns a new thread in which the 
agent will execute as shown in step 42. A persistent local 
copy of the agent is then made as illustrated in step 44. 
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As depicted in step. 46 the agent manager invokes the proper 
method of the agent for execution in the spawned thread at 
this node. The itinerary contains information indicating 
which method should be invoked at each designated destination 
computer. The agent then executes as illustrated in step 50. 

When the agent has completed execution of the indicated 
method, another persistent copy of the agent is stored on the 
local disk as depicted in step 52 in order to prevent 
redundant execution in the event that the computer 
malfunctions before the agent migrates. The agent manager 
then examines the agent itinerary as illustrated in decision 
step 54. If the itinerary does not indicate any further 
destinations then agent execution is deemed complete as shown 
in step 56. However, if the itinerary indicates further 
destinations, then the agent manager determines whether the 
next destination is associated with another computer in 
decision step 58. If the next destination is not another 
computer, flow returns to step 44, thereby bypassing network 
traffic. However, if the next destination is associated with 
a different agent manager then a network connection to the 
indicated agent manager is established as depicted in step 
60. The destination contains a string which indicates where 
to travel. The string contains either the name (host name) 
of a computer or a URL to a distributed object. The agent 
is then serialized as illustrated in Step 62 and subsequently 
transmitted to the next agent manager as depicted in Step 64 . 

Migration in accordance with the itinerary 28 is further 
illustrated in Fig. 6. The itinerary includes a listing 
including identification of each agent manager 66 to which 
the agent is configured to migrate and identification of a 
method 6 8 to execute at each respective agent manager. The 
agent migrates through the agent managers listed in the 
itinerary sequentially in the order in which the servers are 
listed, invoking each respective method upon arrival. Such 
method could be, for example, querying or updating a database 
on the destination computer. 

Fig. 7 illustrates the agent runtime environment. Each 



WO 98/21662 



PCT/US97/20232 



computer 70 on the network includes a Java Virtual Machine 
72 running therein. A agent manager 74 runs on each 
respective Virtual Machine 72. The agent manager includes 
a plurality of threads 76, each thread having an agent 78 
associated therewith. In particular, a new thread is formed 
when a new agent arrives at the server, and the agent 
executes on that thread. Security mechanisms prevent each 
agent from operating outside the scope of the associated 
thread. When agent execution completes, the agent migrates 
to the next destination identified in the itinerary. 

In order for migration and execution to function 
properly, the agent manager modifies the mechanism by which 
Java loads classes. The Java standard library provides an 
object called a "ClassLoader" which can be subclassed by a 
programmer to modify the rules that Java follows to load 
classes. The ClassLoader class allows web browsers to 
download -applets" from a web server. The agent manager 
provides a specialized ClassLoader which allows the 
executable code for mobile agents to travel with the agent. 

During a typical execution of a Java program, a Java 
interpreter loads classes as needed for execution from a 
logical file system on the local computer. However, agents 
become separated from the home computer and the home codebase 
during migration, i.e., agents are separated from the 
directory or directories on the filesystem of the home 
computer where the code is stored. Further, sub-objects 
sometimes need to be created as the agent executes, either 
as member variables or as temporary variables within the 
methods. These sub-objects could be instances of classes 
which are part of the standard Java packages or they could 
be instances of new classes written by the programmer of the 
agent. However, since the agent is executing on a different 
computer than the home computer following migration, the Java 
virtual machine may not be able to directly retrieve the code 
for the particular sub-object. To allow agents to properly 
load classes and construct objects when remote from the home 
computer, a special ClassLoader is employed by the agent 
manager whenever an agent attempts to construct an object. 
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The ClassLoader object first attempts to locate a class on 
the local file system of the computer. If the class is not 
on the local file system, the ClassLoader searches the mobile 
codebase. If such attempt fails, the ClassLoader sends a 
request back to the home machine of the agent. The agent's 
travel information contains a reference such as a URL which 
refers back to the home codebase on the home computer, and 
by accessing the URL the ClassLoader can retrieve classes 
from the home computer. 

Agent deserialization is illustrated in Fig. 8. As 
depicted in step 80 the serialized agent arrives as a stream 
of data. Java Development Kit Object Serialization classes 
then call an agent manager related method to perform 
deserialization as shown in step 82 . The method reads agent 
related objects from the object stream as depicted in step 
84. In particular, the mobile codebase, itinerary and 
codebase URL are read by the method. A custom Classloader 
and Object InputStream are constructed as shown in step 86. 
Object Serialization then reads the agent and other objects 
from the input stream as depicted in step 88 and step 90, 
respectively. When the related objects are read, the 
ClassLoader retrieves the classes which comprise the agent 
as illustrated in step 92. 

The new object's class is loaded once the classes are 
retrieved. As depicted in step 94, if the class is 
determined to have been previously loaded then the previously 
loaded class instance is employed (step 96) and the object 
is instantiated using the loaded class object as shown in 
step 98. However, if the class has not been previously 
loaded as determined in inquiry step 94, then inquiry is made 
as to whether the class is on the local class path of the 
destination computer as illustrated in decision step 100. 
If the class is present on the local machine then the class 
is loaded therefrom as shown in step 102 and the object is 
instantiated using the loaded class object as depicted in 
step 98. However, if the class is not found on a local class 
path as shown in step 100 then an inquiry is made as to 
whether the class is in the mobile codebase as shown in step 
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104 . If the class is located in the mobile codebase then the 
class is loaded therefrom as shown in step 106 and the object 
is instantiated using the loaded class object as shown in 
step 98. However, if the class is not located in the mobile 
codebase in decision step 104 then the class is loaded by 
accessing the home codebase as shown in step 108. If the 
codebase pointer is an Internet type pointer such as a Hyper- 
Text Transfer Protocol ("HTTP") URL, as determined in inquiry 
step 110, then an HTTP request is sent to the local web 
server as shown in step 112 and the retrieved class is added 
to the Mobile CodeBase as depicted in step 114. However, if 
the codebase URL is not a HTTP URL then a remote method 
request is sent to a RemoteClassLoader object as shown in 
step 116 and the class is added to the mobile codebase as 
shown in step 114. In either case, the object is 
instantiated using the loaded class object as shown in step 
98. If more objects exist in the stream to be retrieved, as 
determined in decision step 118, then another object is read 
from the input stream as illustrated in step 90. If there 
are no more objects to be retrieved, flow terminates. 

Having described the preferred embodiments of the 
invention, other embodiments which incorporate concepts of 
the invention will now become apparent to one of skill in the 
art. Therefore, the invention should not be viewed as 
limited to the disclosed embodiments but rather should be 
viewed as limited only by the spirit and scope of the 
appended claims. 

A program listing follows in the attached APPENDIX. 
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'thtrbductibn : ":T. -■' ^- ■'??£■■. 

This document serves as a patent disclosure on the invention enlitledDj>/ia//nc 
Synchronous Collaboration Framework for Mobile Agents. This document includes a 
discussion of: prior art, problems with prior art. details of the invention, and improvements 
of this invention over prior art. 

■ prior ^ ■ ■ V -:: • 

"Agent" is one of the most overused terms in the software industry today. Although the 
term may be used in a wide variety of contexts, software Agents can be classified into two 
major categories: Intelligent Agents and Mobile Agents. Although the two differ in scope 
and capabilities, both types of Agents are able to perform work asynchronously and 
autonomously on behalf of their owners. Intelligent Agents arc endowed with some 
degree of reasoning and learned behavior and may make decisions on behalf of their 
owners. These Agents are generally stationary and execute on a single system. Mobile 
Agents, on the oilier hand, may be transported across nodes in a network, performing 
computations as they migrate. 

The original concept for Agents stems from the Artificial Intelligence community. The 
behavior of Intelligent Agents may be determined by programming or by decisions made 
by the Aoents on behalf of their owm-rs. As an example, an Intelligent Agent may search 
a database for unusual outdoor scenery, making ils own decisions as u> whether or not 
each scene meets Ihe specified criteria. 

Intelligent Agents generally employ boiii synchronous and asynchronous modes of 
communication. Agent communication may lake the form of queries or collaborative 
computations. In the realm of Agent computim; collaboration may be defined as "the 
coordination of the computations of multiple Agents to achieve a desired result" (e.g.. to 
solve a complex problem). Collaboration often results from discovery (i.e. the need to 
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collaborate with a specific Agent regarding a certain subject is not known a priori, but is, 
rather, determined as a result ol" the Agent's computations.) 

Both the interaction between these Agents and ihe context in which they execute must be 
formally specified. Standardization has not yet been achieved lor these objectives. 
However the prevalent means for accomplishing these results is via implementing a user 
model and specifying queries and assertions by using a knowledge representation 
lanuuaue, the most popular of which is currently Knowledge Query Manipulation 
Lanuua»c (KQML), and by developing Ontologies, or vocabularies ol common terms to 
be utilized by interacting Agents. KQML is comprised of both a language, with a syntax 
unlike procedural or object-oriented languages, and a communications protocol. An 
Ontoloey is defined as "an explicit specification of a conceptualization". The syntax ana 
semantics of an Ontology arc generally extensions of a first-order predicate calculus, 
typically the Knowledge Interface Format (KIF). 

The combination of KQML. KIF. and Ontology development is a complex task. Some 
implementations utilizing these mechanisms arc being developed in the Arlihcial 
Intelligence community. But this approach has not caught on in other sollwarc 
applications. 

In contrast to Intelligent Agents. Mobile Agents arc usually explicitly programmed to 
accomplish a specific task. As an example, a Mobile Agent could migrate to travel 
agencies on the World Wide Web and determine the lowest cost air lare between two 
cities. In this case, there is no need for learned behavior or complex reasoning. 

However the amount of information accessible on distributed systems, including 
databases the Internet and Intranets, is growing at a staggering pace and much ol it is 
available in incompatible storage formats. The need to filter information and make 
decisions based on its content is increasing, and with it. the need for increased 
collaboration among Mobile Agents. 

The need for collaboration is illustrated by extending the above travel agency example. A 
Mobile Agent may need to clone itself and instruct each of its counterparts to migrate to a 
different travel agency site to obtain the best package for a trip to one or more ski resorts 
meetine certain parameters, including air fare, lodging, mc;:!s. Mil tickets, and car rental. 
Furlhmnore, the information may, itself, be sio.ed in different formats (databases, etc.). 
necessitate some amount of filtering and data reformatting. Once the Agents have 
obtained their information, they need to collaborate with each other to correlate their 
resulls and determine the best package available at each resort lor diflereul travel dales 
and the overall best deal. 

Mobile Aliens are e volvinu lu include inae^ed imclli^ic,: ami collaboration. Some 
research organizations have begun incorporating KQML and Ontologies into Mobile 
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Agent implementations, while other utilize different knowledge representation languages 
uTimplcmcnl Agent communication. Still, oi'icrs use proprietary object languages. 

3^ Prbblems^ - 

The KQML/Onlology mechanism and other knowledge representation languages arc ill- 
suited for general-purpose software applications. They require programmers to learn 
multiple languages to formally specify communications and to develop complex 
dictionaries of terms - a task that is currently ill-defined. The knowledge representation 
languages are also extremely unlike the procedural and object-oriented languages utilized 
in building business and general-purpose software applications. 

The need to support asynchronous collaboration adds significant complexity to Agent 
systems implemented via knowledge representation languages (e.g. KQML) and 
Ontologies. Furthermore, there exists a class of Mobile Agents which solely require 
synchronous collaboration, e.g.. the travel agency application described above. This type 
of Agent application essentially subdivides a larger task into smaller pieces and creates 
Agents to migrate throughout the network to accomplish it. For these Agents, there is no 
benefit in die added complexity of coding in multiple languages and developing 
Ontologies, nor in the support for asynchronous communication. A synchronous 
collaboration framework in the Agent's language is the best means for these Agents to 
coordinate their results and implement adaptive behavior. 

Corral Details pfthe invent!^ \ -V.'. .-. 

The dynamic synchronous collaboration framework uiiliy.es a distributed synchronization 
point plus object-oriented abstractions to provide synchronous collaboration for Mobile 
Agents in a distributed system. The framework simplifies collaboration for applications 
which subdivide a complex problem into several pieces and farm out the work to multiple 
Mobile Agents. 

This framework enables Mobile Agents within an application to perform synchronous 
collaboration with one or more affiliated Agents in the application's native language. This 
is accomplished via WvcA^eiu Grow abstraction. Agents wishing to collaborate with each 
other must belong to one (or more) of the same Agent Groups. The fundamental principle 
behind Agent Group collaboration is that Mobile Agents performing sub-computations, 
possibly on different nodes in a distributed system, will need to periodically correlate their 
results, and potentially adapt their behavior hased on the results of the correlation. The 
Agent Group acts as ;i distributed synchronization point foi iiiis type of synchronous 
collaboration. 
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Thc dynamic nature of the Agent Group enables Agents to join and leave the group at 
will. Hence no a priori knowledge ol the actual Agents comprising a group is required 
and group membership may change over lime. 

A distributed name space maintains a reference to each Agent Group. Hence. Agent 
Groups may he located via iheir entry the name space. When an Agent Group is created, 
it is automatically added lo the name space. 

The Agent Group's primary responsibility is to facilitate synchronous collaboration for 
Mobile Agents. However, it also serves as a central point for distributing asynchronous 
events to Agents in the group. A typical event may be the termination of a particular 
Agent. As a side effect? the Agent Group also tracks the travels of its constituent Agents 
throughout the network. 

The travel agency example illustrates the function of Agent Groups. The problem to be 
solved can be slated as follows: A user wishes to determine the best package for a trip to 
a ski resort. The Agents must determine the best travel dale and time (e.g. any week in 
February starling on a Saturday, and flying before noon) and lodging must meet certain 
criteria (e.g., a two-bedroom condominium) . The trip includes all expenses (e.g., air fare, 
lodging, meals, transportation, and lift tickets). The user may also specify several possible 
travel destinations. 

This application is composed of multiple Agents - each is responsible for querying one or 
more data sources (in perhaps different formats) for specific information (e.g.. searching a 
particular travel agency's database of promotional trips to determine if any meet the 
criteria specified by the user.) Some Agents may query legacy database systems, whereas 
others may search ODBC compliant databases. (The actual mechanisms for handling 
different data sources is beyond the scope of this invention.) 

Before the Agents are transported throughout the network they join a new Agent Group. 
The Agent Group tracks its Agents' travels throughout the network. At any point, an 
Agent may be in one of several states. Figure 1 depicts three Agents in an Agent Group 
performing computations and one Agent in-transit between nodes. 

AUlilTorciii points during their migration. Agents may wish Ux;onelale then results, and 
potentially change their migration plans or behavior. Suppose each Agent migrates to a 
local travel agency. Before migrating to travel agencies in different cities, the Agents may 
wish to cm relate their results and potentially adjust their behavior. Suppose one of the 
Agents determines that a particular ski resort, say Taos, has no iwo-bedroom 
condominiums available during February. The Agents in the group may wish to drop all 
further queries about trips to Taos. 

Agent Group collaboration is implemented via a distributed synchronization point (also 
known as a collaboration point) and a software routine to analyze the results of each 
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Agent's computation. The Agent Group abstraction provides the distributed 
synchronization point. Each application need only provide its own software method to 
analyze the results and potentially 'allow each Agent to adapt its behavior. 

The distributed synchronization scheme requires that each Agent arrive at the 
collaboration point before collaboration may commence. Hence, it is best suited to 
applications that subdivide a complex problem into many sub-tasks that need to correlate .. . 
their results. As each Agent arrives at the collaboration point, u posts the results of its - 
computations to the Agent Group, and blocks until all the other Agents in the group 
arrive. Figure 2 depicts one Agent in the group waiting to collaborate while three others 
are still performing computations. 

The Agent Group collects the results of each Agent's sub-computation. When all Agents 
have arrived at the collaboration point, as shown in Figure 3, the Agent Group notifies 
them that collaboration may commence. When it unblocks the waiting Agents, the Agent 
Group passes the collected results to each Agent. Each Agent then calls the application- 
specific method to analyze the results and potentially adapt its behavior. Figure 4 shows 
that all Agents have arrived at the collaboration point and are now in the analysis stage. 

The synchronous collaboration framework supports both parallel and serialized 
collaboration analysis. Figure 4 depicts a parallel analysis implementation; Figure 5 
illustrates a serialized collaboration analysis, in which one Agent is in the Analysis state, 
while the rest remain wailing in the Collaborate stale. 

The distributed collaboration point may be implemented via an object transport or by an 
RPC mechanism. It may also be implemented in any procedural or object-oriented 
language. Object-oriented languages simplify the implementation, as the application need 
only subclass the Agent Group abstraction and provide a concrete method to analyze the 
results and potentially adapt the Agent's future behavior. 

The Agent Group ensures that all Agents in the group arrive at the synchronization point 
by tracking the Agent's migration through the network. In the current implementation, as 
part of a mobile Agent system, a server (known as the Conduit Server) on each node 
manages the Agent's migration and informs each of its Agent Groups when the Agent 
arrives and departs. Should an Agent fail to arrive at a collaboration point in a pre- 
determined, configurable length of time, the Agent Group will "ping " the Agent by 
sending a message to ensure that it is still alive, as shown in Figure 6. (In the current 
implementation, this is performed via the Conduit Server on the node where the Agent is 
executing.) If the Agent fails to respond to the ping, the Agent Group notifies the other 
members of the group by distributing a Collaboration Failed asynchronous event to them 
that indicates that a particular Agent is not responding. The Agents may then indicate 
whether or not they wish to proceed with the collaboration. Figure 7 depicts the Agent 
Group's distribution of a Collaboration Failed event followed by the remaining Agents 
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indicating that they wish to continue the collaboration. Alternatively, the Agents could 
decide to abort the collaboration. 

The Agent Group also implements deadlock detection by means of the time-out 
mechanism and Agent ping described above. The ping actually returns the state ol" the 
Agent in question (via the Conduit Server). IT the Agent is already in the Collaborate slate 
but has not arrived at this collaboration point, a deadlock has occurred. This is shown in 
Figure 8. In this case, the Agent Group will abort the collaboration and notify the Agents 
in the group of the deadlock by sending them a Deadlock Evcni. as shown in Figure. 9. 
Note that since Agent Group collaboration is designed for closely coordinated Agents, the 
existence of a deadlock is generally a result of a programming error. Hence, the Agent 
Group does not need to employ a more sophisticated scheme for deadlock detection or 
avoidance. 

Agent Groups provide reliability by saving the state of each Agent in the group to 
persistent storage. If the Agent Group should terminate unexpectedly, it is restarted and 
reads the state of the group members from persistent storage. The Agent Group's restart 
is transparent to the Agents. They actually communicate with an Agent Group Proxy 
(instead of an Agent Group), which shields them from Agent Group failures. 

Figure 1 1 illustrates the How of a typical collaborating Mobile Agent. Each Agent creates 
an Agent Group Proxy for each Agent group it wishes to join. The proxy's primary 
responsibility is to maintain an active connection to its associated Agent Group and to re- 
establish the connection or re-create the Agent Group, as needed, during Agent Group 
failures. 

When the Agent Group Proxy is initialized, it establishes a connection with the appropriate 
Agent Group. It first attempts to find a reference to it in the name space. If this fails, it 
creates the Agent Group and enters a reference to it into the name space. The algorithm 
guarantees the atomicity of this operation. 

After the proxy has created the Agent Group or established a connection to it, the Agent 
continues its computations and migrations. Eventually, it may attempt to collaborate its 
results. This is accomplished by means of the Agent Group Proxy. If the Agent Group 
has failed or is in a unknown state, the proxy will he unable to contact it. If this occurs, 
the Agent Group Proxy retries the communication. If. at this point, the proxy is still 
unable to communicate with the Agent Group, it recreates it and updates the name space 
with a reference to the new Agent Group. The re-creation of the Agent Group is serialized 
to prevent multiple Agent Group Proxies from simultaneously doing so. If a proxy 
determines that the Agent Group is in the process of being re-created, it simply waits until 
it can find a reference to the new group in the name space. Once the Agent Group has 
been re-created, the proxy retries the collaboration. 
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As mentioned earlier. Agent Groups provide a distributed events mechanism in addition to 
the synchronous collaboration framework. The distributed events mechanism enables the 
Agent Group to notify members of the group of outstanding events, such as the 
termination of an Agent, or the detection of a collaboration deadlock. Agents may build 
on this mechanism to forward application-generated events to other members in the group. 
Hence, if an Agent catches an application-generated exception it may notify the other 
Agents in the group before terminating. Figure 10 illustrates how the Agent Group 
forwards an Exception E vent, generated by one of its Agents, to the rest to the group. 

Currently, the Agent Group handles distributed events by maintaining a (possibly remote) 
reference to an event queue associated with each Agent. The Agent Group forwards all 
events it receives to the other members of the group by enqueuing it. The Agent Group 
may be implemented without a remote referencing capability, but this would add 
significant complexity. In the current implementation, each Agent contains an events 
thread which is responsible for dequeuing the event and calling the application-specific 
event handler. (This thread could easily be a process, if threads were not available.) 

In addition to forwarding events to members of the group, the Agent Group may generate 
its own events and distribute those to the group members. As an example, the Agent 
Group distributes a Deadlock Event to the group members when its detects a deadlock 
situation, as illustrated in Figure 9. 

As mentioned earlier. Agent Groups track the migrations of their constituent Agents, with 
help from the Conduit Server (in the current implementation). If an Agent is in transit 
when the Agent Group is forwarding events, it queues the events locally, as shown in 
Figure 10. Once the Agent arrives at its destination, it notifies the Agent Group, via the 
Conduit Server. The Agent Group then flushes the events it stored locally for that Agent. 

Agent Groups implement varying levels of persistence, as defined by the actual 
configuration. Memberships and Agent slates arc updated infrequently, sothey are 
generally written to persistent storage. However, local queues maintained on behalf of in- 
transit Agents may also be saved in persistent storage, if desired. 

Implementation of the Agent Group in an objeet-orienit-.d language enables applications to 
extend its functionality, if required, by subclassing the Agent Group object. 

The work described above provides several benefits, li greatly simplifies the 
implementation of synchronous collaborating Mobile ApouLs. especially for applications 
that subdivide a complex task into a series of related sub-tasks. There is no need for 
application developers to learn knowledge query representation languages, such as 
KQML, or to develop complex Ontologies. The dynamic synchronous collaboration 
framework provides a natural programmatic implementation that may be programmed in a 
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Design Specification for Java Agent 
Coordination 

Version 0.2* 
vi;: ; Introduction 

Java aeems have the capability of cu>rdinating their activities. Tins coordination lakes ,two 
main forms: synchronized collalxjration aiul asynchronous notifications. T hese modes of ^ 
coimnunicaiion coinpleinem each oilier and (heir implementations are reUned. 

Collaboration 

TTic collaboration paradigm is implemented as follows: 

• multiple agents perform compulations ai different nodes in die network; 

• after per tormina all or a subset of their operations, agents wail at a distributed 
synchronization point until all agents have "arrived"; 

• ancnts coordinate by potentially serialized execution of a synchronized method. 

Coordination can take the form of performing compulations on intermediate results and/or 
updating agent itineraries. 

Notification 

The notification scheme uses a distributed events mechanism to communicate agent state 
changes that occur asynchronously. It is mainly utilized lor distributed exception handling, 
but may also be used to notify related agents of events, such as another's termination. 

As described nlx)vc, agent coordination utilizes distributed synchronization and event 
handling. However, Java possesses neither of these. Actually, its synchronization primitives 
are limited to: critical sections on a single system and a notification scheme that can only 
handle a single iypc of event. Hence, a great deal of the complexity in ihe task of agent 
coordination is comprised ofimplcmcuting mechanisms to overcome Java's unsuitability for 
distributed processing. These mechanisms are dcscrilxxJ in the remainder of this document, 
along with the new objects thai implement them 



' Revision History: 

07/26/96 Version 0.1 Initial revision. 

1 1/12/96 Version 0.2 Major changes 10 Notifications ami llxtcpiions and Collaboration sections 
reflect actual implementation. Removed I -vents section. 
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As mentioned above, agent coordination requires distributed s>iichroni/auon mechanisms, 
such as locks and events. Since Java does not provide any distributed locking, we are faced 
will) tlic following choice: 

1 . Utilize a centralized locking scheme. 

2. Develop our own distributed locking paradigms. 

3. Use Java's native methods to interlace with the operating system's synchronization 
primitives. 

The latter choice is unacceptable because it compromises Hie portability of our agent 
infrastructure, whereas the first option may potentially introduce considerable network 
overhead. The second alternative also requires significant development eflort even to 
implement a well-known solution to the problem. 

In the interest of expediency (as required by the tightness of our schedule), Hie initial Java 
agent infrastructure utilizes RMI to implement a centralized locking scheme. Locking is 
implemented via method invocations on a potentially remote object (called an A$eniGroup. 
See Section 3 for details.) Agent coordination is implemented by (remote) invocations on a 
method which requires synchronized access. (See Section 3.) 



AgentGroup 

Agents that mav wish to collaborate their results subclass CulhihuniioiA^nu an abstract 
class derived from Ayeiu. Collaborator Agent contains a minimum of two threads - one to 
perform compulation and to travel and another to handle asynchronous event notifications. 
Applications that contain collaborating agents subclass Collaborator Agent and. ol course, 
these derived classes may implement several compulation threads. 

Tach collaborating agent belonas to one or more agent groups, which are described by Agent 
Group objects. Aaeni Croup is actually a distributed KMI object. A^uGivup defines the 
interface; AyeniGnmplmpl, an abstract base class derived from PcrsisizniEventGrouplmph 
provides the implementation. (See Design Spccijictiiion for Dismbuted Java Events for a 
description of Persisteml-vcniGrouplmpl.) 

An AccmGroup is essentially a unit of coordination. Hence agents may coordinate with all 
die other agents in an AgentGroup. They may also create new As-cniGroups on demand, and 
join and leave groups :it will. (In practice, AgentGroup must be subclassed to implement 
aeent collaboration. However, this document does not distinguish between the base class and 
its derived classes and refers to them collectively as AgcnlGroups.) 

An VeniGroup is an object that is essentially shared among the members of an agent 
coordination group, it is owned by the Agent thai initially creates the group (an agent group 
is created by instantiating AgentGroup) and accessed via a potentially remote RMI reference. 

The relationship between Collaborator Agent and AgentGroup is similar to dot of Thread 
•md ThrcadGroup- A ThrcadGroup maintains references to the Threads composing ihe 
croup- an AueuiGruup maintains a similar list of iis Collaborator Agents. Both 
ThreadGroups and AgcnlGroups form a hierarchy and each contains a relerencc to us parent 
oroup Thread's constructors are eidier passed a reference to a ThrcadGroup or they save a 
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reference 10 die parent's Thread s croup. Likewise, Collaborator Agent's constructors may be 
passed one or more AgeniGroups or save a reference to AgentGroiip of its parent, if it exists. 

However, there is one noticeable difference between the two types of groups. A Thread may 
only belong to one ThrcadGroup at a time, whereas a Collaborator Agent may simultaneously 
he a member of several AgeniGroups. which constitute a hierarchy. Hence, Threads contain 
a reference to their associated ThreadGroup, but Collaborator Agents maintain a list of 
references to their AgeniGroups. 

Support for multiple AgeniGroups facilitates coordination among related groups of agents 
and also enables the creation of an Agenldroup hierarchy through winch communication 
may be propagated. The pilot application may utilize multiple agent groups, as shown in 
Figure I. 

This figure portrays an example of two AgeniGroups: AgentGroup A consists of three 
ascitis - one on each LAN in the system, whereas AgentGroup H contains agents on multiple 
nodes on LAN 3. A distributed application running on a configuration such as litis typically 
creates multiple AgeniGroups when it needs to traverse the WAN. In this case, 3 agents are 
created in AgeniGamp A, one for each LAN. Once they arrive on a node, these agents clone 
themselves, "creating autre agents to be distributed across nodes on the LAN (e.g., 
AgentGroup H). This approach minimizes network traffic over die WAN and forms a multi- 
level hierarchy of AgeniGroups. Agents in the intra-LAN groups (e.g., AgentGroup li) can 
communicate their results, which can then be coordinaicd with the inter-LAN group (i.e., 
AgentGroup A). 




Figure I: Multiple AgeniGroups 
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iiy default, UMI passes all local objects by copy. However, the above scheme requires that 
each Agent actually maintain (remote) references to its AgentGroups. Hence, the agent 
infrastructure overrides some of KMTs object serialization methods to generate the required 
references. 

4-; ? Nptificatibns and Exceptions 

Doth asynchronous noiificaiion and collaboration are implemented via the associated 
AucniGroup object. The following description serves as an example of asynchronous 
noiificaiion handling via distributed events. (See Design Specification for Distributed Java 
livents for more details on event handling.) 

1 . An agent catches an exception and wishes to notify the other members of the group. 

2. The agent posts an A^entExceptionEvent to the AgeniGroup via the groups pom Event 
method. The Agenil-xceptionlivent indicates the type of exception that occurred. 

3. The AgeniGroup posts' the Agcuil.;.\ccpiionl-vcni lo the other agents in the group. 

4. Each agent's liven i Handler performs application-specific handling of ihe 
lixccpiumEvcm. 

If the agent that caught the exception wishes to notify another associated Agcm Group, ii 
repeals the above procedure with the next AgeniGroup object. 

Occasionally, the Agent Group may generate events that it directly forwards lo a mcmi>cr of 
the iiroup (e.g., to "ping" ii after it fails to arrive at a collaboration point) or others thai it 
"multicast*" to its members (e.g., an Agent's failure lo reply to a ping). 

5, ••• Collaboration 

Agent collaboration is more complicated than asynchronous notifications. It is implemented 
as follows: 

1 . An agent performs some computation and arrives ai a synchronization point. 

2. The agent performs a (remote) invocation of the Agen (Group's collaborate mcUuxl, 
passing it an At{ent Stat us object. 

3. If no collaboration is in -progress (i.e., this is the first agent that has requested 
collaboration), collaborate calls its synchronized bei>inCollaburate method, which 
initializes the number of agents to wait for before collaboration may Iwgin (i.e., if- 1 for 
an ;i -agent group.) (Race conditions are handled by checking if the agent count has 
been initialized (i.e.. U i.s non-zero) Ixrfore continuing. A lace implies that two agents 
are attempting to initiate the &amc collaboration. Otherwise the application is 
scmantically incorrect.) This routine saves the requesting agent's unique ID (obtained 
from the AeentStaius object) and starts a collaboration timer (with sufficient time for 
agents to arrive across the WAN) by passing a configurable lime-out value to the 
AgentGroup s wait method. 

4. Otherwise (i.e., if a collaboration is in-progress), collaborate calls the synchronized 
(lecrementColtabomte method to add ihe requesting agent's unique ID to the list of 
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agents arriving ai the collaboration point and to decrement the waiting agent counter. If 
the counter is non-zero, this method hlocks with no time-out value. Otherwise, the 
Agent Group awakens the other threads wailing for collaboration to commence. 

5. If the timer expires, all agents did not arrive at the collalx>ration point in time. This 
may occur because an agent received an uneaughi exception and terminated 
unexpectedly or because a deadlock condition exists. (Since agents may belong to 
multiple groups, overlapping collaborations could result in deadlock. However, a 
properly coded application will not generate deadlocks because the collaboration points 
must be known a priori and must be executed in the same order among collaborating 
agents, i.e.. collaboration must first handled at the leal' Agent Group and propagated-up 
the hierarchy.) If a time-out occurs, the Agent Group thread initiating the collaboration 
(on behalf of its associated CoIlaboratorAgeni) is awakened and performs the following: 

• It calls the AgcniGroup's chevkCollaborate inctluxJ which returns the collaboration 
state (either CoUaborationSacvevded or Collaboration Failed, depending on the 
value of the waiting agent count). 

• If the collaboration failed, the collaborate method calls recoverCollaburate. This 
method attempts to communicate with the agents that did not arrive at the 
collaboration point by "pinging" them. (It determines these agents by comp;iring the 
list of arrived agents with the group membership.) The ping is actually performed 
via a message to the Conduit Server on the node where each agent was last known 
to be executing. If lite agents are located and any of them is in the Collaborate state 
and but has not arrived at this collaboration point, a collaboration deadlock has 
occurred and the collaboration state is set to CollaborationDeadlock. If any of the 
agents cannot be located, (he collaboration state is set to Collaboration Tailed. 
Otherwise, it is set to Collaborationist iy and the Agent Group thread retries the 
collaboration up to a configurable number of times (after which the stale will lie set 
to Col laborationl "ailed if the collaboration still limes out.) 

• The initialing Agent Group thread wakes up the other blocked threads by calling 
notify All on the AgenK iroup. 

6. Once all the collaborating Agent Group threads have been awakened, (either because the 
counter has dropped to 0_ or a time-out occurred), tliey call the AgeniGroup's 
checkCollaborate method. If this method returns a state other the 
Collaborations ucccedcd, each thread returns the appropriate exception (i.e., cither 
CollaborationFailedException or CollaboraiiunOeadlockException) to its invoking 
Collaborator Agent . 

7. If the collalx>ralion stale is ( !ollnlxiraiioiiSucccedcd, collaboration commences by 
executing a potentially synchronized application-specific method, analyze lie suits, to 
perform the collaboration. analy/eUesnlts is an abstract AgentGroup method that must 
lx* implemented by derived classes to perform applicai ion -specific collaboration. As a 
result of collaboration, iigoni itineraries may l>c updated. 

8. As each thread completes its collaboration, it replies to ihe remote collaborate 
invocation, passing any state specified by the implementation, (e.g., updated itineraries). 

9. The agents then continue execution on their current mxle and travel as required by ihcir 
itineraries. 
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As described above, collaboration requires complex mechanisms. However, most of these 
are necessitated by the limited synch roniznt ion primitives provided by Java. 
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Design Specification for Distributed 
Java Events 

Version 02 l 
1. Introduction 

This document describes a gen cm I -purpose solution to distributed eveiu management. 

2: ■■'Overview 

This section provides a hiuh-lcvcl description of the objects that implement the distributed 
events framework. 

2.1. Objects 

Events 

Events are descried by classes thai derive from liven (Type. I'-ach HvuniTvpe object 
includes: a unique \D (a Siring) generated by the constructors and a description of the event 
(a String) optionally passed to die constructors. 

Event Handler 

The EventHcmdler interlace specifies the liandleEvenK) method which implements an hvem 
Handler, l-ach application must provide its own P.venl Handler to perform application- 
specific event management. 

Event Notification 

The Event Past interface specifies the postEventi) mctluxl which implements event 
notification. Several of die classes described below implement this interface. 

Eveui Gue«ja 

Ahv object retvivin!' notification of events must own an i * vent Queue and an associated 
thread that manages the queue. The Hvent Queue's constructor is passed an l-ventl landler 
stub. It instantiates an Event Queue Thread (a protected class derived front Thread) to 
manage the queue and passes the I -vent Handler stub la its construe! or. The 
EvcniQueueThrcad's nmO meUiod removes events from the (pteue and calls the 
handleHvcntO method. 



' Revision History: 

09/26/96 Version 0.1 Initial revision. 

1 1/12/96 Version 0.2 Ijcpandcd discussion of P.venl Manner and l:vcm (iroup. Added Reliability 
Fcaiui cs and Garbage Collection sections. 
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An Event Queue is a distributed RMI object. RvcniQucuchnpl implements the Event Post 
interface by appending the specified HveiuType object to the queue and calling the associated 
Eve nt Que tteTIt read' s notifyi) meihod. 1 nis action wakes up the EventQueueThread (if it was 
blocked). The thread then proceeds to dequeue each pending event and pass it to the 
handlcKvcntO method 

Event Manager 

The I -vent Manager handles the registration, posting, and notification of events. When 
objects request notification of specific event types, they must pass the Hvent Manager a . 
reference to their i-vcmPosi interlace. The livent Manager saves the reference in a hush table 
that it uses to map event types to their notification requests. When an object posts an event 
(via the livent Manager's postlivcntO method), the I -vent Manager obtains the list of objects 
10 notify from the hash table and calls each of their post I -vent 0 methods. 

The Event Manager also maintains a list of objects thai have requested notification of all 
events. Whenever it receives an event, the Event Manager also forwards if to these objects, 
by calling each of their postHveiuO methods. 

HventManager is an RMI distributed object. Event Manager describes the interface, whereas 
Event Manure rlmpl provides the implementation. 1 -vent Manager defines methods to manage 
event registrations (e.g., add and delete registrations). 

EvcntManagcrlmpl also implements the livcniPost interface. Its postlivento meihod is 
passed an event from its originator and notifies the recipients of the event by invoking their 
postlivcntO methods. 

At most one Event Manager runs on each node in the Agent system. A reference to it can Ix; 
obtained via the RMI Registry. 

Event Group 

A group of objects interested in a common set of notifications may form an Event Group. 
HveniGroup is a distributed RMI object: EvetuGwup defines the interface; EvcntGrouptntpl 
consists of the implementation. EvciitGroup defines methods thai manage the group (e.g.. 
add and remove members). 

Whereas die Event Manager filters posted events on behalf of its clients, forwarding them 
only the events they requested, the livent Group performs no filtering. EvcniGroupImpl 
implements the EveniPost interface. However, its postHvenU) method forwards each event it 
receives to every member of the croup (by calling their postlivcntO methods). 

in practice, Hvent Groups should Ik* used sparingly Ix-catisc they could allow an abusive 
application to generate unwanted notifications. The Agent framework does utilize this 
mechanism, but it verifies that all events are generated by a group nieml>ci and it only 
utilizes the P. vent Group for some well-known events, such as the termination ol an Agent. 

Each livent Group is identified by a unique name either passed to us constructor or assigned 
by it. Objects may obtain a handle to a particular I -vent Group by presenting the RMI 
registry with this unique mime. 

2.2. Reliability Features 

The Distributed Events framework incorporates several reliability features. These generally 
take the form ol" persistent slate and proxy objects. 
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Event Mana 9jJ c Dislribu{clJ nvclUS framework shields objects from ihc effects ofl-vciu Manager failures 
in two ways: 

• by saving its stale (i.e., event registrations) to persistent storage, and 

• by encapsulating its functionality in a proxy ohiecl. 

The Hvcni Manager saves the following items in the persistent store: 

. the hash table mapping specific event types to the objects registered to 
receive them and 

• the list of objects to be notified of all events. 

Rich time an object either registers or "unregisters" us 'interest in receiving any (or all) 
events the Hvem Manger writes the updated event registrations (i.e., cither the hash table or 
Hie list of objects, but not both) to persistent smnujc via the Persistent Storage Manager. 
These are fairlv infrequent operations, so the performance impact ol this process should be 
negligible. (See Design Specification for Java A R ent Persistence Package lor detads on the 
Persistent Store Manager.) 

Whenever the Hvem Matuu-cr is started, iis initialization axle attempts to recover any 
existing event registrations from persistent storage. Hence, registrations are not lost when 
the Hvem Manager fails. 

In addition, the Hvem Manager Proxy also prevents Objects from experiencing the effects of 
IveiU Manager failures. It acts as a wrapper object lor the Hvcni Manager, hach Object 
wishitii! to communicate with the Hvcni Manager mum first creaie an EventMana H erPron 
object "The proxy obtains a reference to the Hvem Manager via the UMI Registry. II, ai any 
point the proxv is unable to communicate with the Hvem Manager, it will attempt to obtain 
a new reference from the registry. It will retry this operation several times bclorc throwing 
an exception. 

Furthermore, if the livcni Manager should tail, it will automatically be re-started by the Java 
Asent System. 



Persistent Event Group 

The Ijismhuied Hvents uamcworu nroviues a general-purpose implementation oi I. vent 
Croups (ie Hvr.mGroup), as described aifc.vc. However it also provides a reliable 
implementation of Hvem Cimups: Persistent Hvem Croups. Persistent Hvcnl Group is a 
distributed KM I object that extends HvcntCroup: Uie interface is defined by 
Persistentl'ventGmiip and the implementation is provided by PenstemLventGwuphnpl. a 
•aihdass of HvemC.rountmpI t'crsisi.-.m I - vein ( iroup iiiilives persisienr storage m murh ihr 
same manner as the Hvent Manager. Whenever an Object juii* or leaves the group, u save, 
a reference to il in persistent storage. 

Each Persistent Hvem Group is also encapsulated in a proxy object: 
PersisientEventGnmpPrnxv. This proxy operates somewhat differently than die Hvent 
Manager Proxy, depending on how it is constructed. In some cases, it will attempt to locale 
a named Persistent Hvem Group in the RM1 registry. If a name is not supplied lo the 
constructor, il will creaie a new Persistent Event Group and register it. 
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Since Hvciu Groups arc temporary objects, unlike the Event Manager, which is a persistent 
server, their proxies cannot expect their associated Persistent I • vein Groups 10 be 
automatically re-started upon failure. Hence, a proxy may re-create the croup if il is unable 
to obtain a reference to it after sufficient retries. 

This, however, introduces a race condition wherein multiple proxy objects may 
simultaneously attempt to re-create the Persistent livem Group. This is handled by the 
following mechanism: 

• II" the owner of the Persistent livem Group detects the failure, il re-creates 
the group. (The owner is defined as the proxy (hat initially created the 
group.) 

• If the owner does not detect the failure in a configurable length of time, 
other proxies may attempt to re-create il. 

• Hie Persistent P.vcni Group is re -created via the following steps: 

• Attempt to create a temporary binding in the KM I name space with a 
well-known name derived from the Persistent I- vent Group's unique 
name. 

• If the binding does tun return an Already ttoumlExccption, proceed lo 
re-create the PersistentlivcniGroup and then remove the temporary 
binding. (Otherwise, another proxy is re-creating it. So wail for ils 
completion.) 

2.3. Garbage Collection 

Uoth the Hveui Manager and livem Group objects must l>e prepared to garbage collect stale 
references. This is simply performed by deleting any objects (i.e., HvcntPost stubs) that il 
cannot communicate with. Hence their posiliventO mctluxls handle garbage collection after 
notifying all interested objects of the event. 

3/ ; 1; \ 

CollaboratorAgent 

The ColitiboratorAi>em class contains a reference to an event queue (i.e., an 
HvcntVJucueimpt object), which is instantiated by its constructors. 

The Hvcni Queue does not persist across an Agent's travels. Hence, its prepare l-'orTransiU) 
method flushes the queue and voids the Agent's reference to the queue before it travels. Its 
associated Agent Groups save any events that occur while the Agent is in -transit. The 
tamiitcittUranspuin) method, called alter the Agent arrives at its destination, constructs a 
new HvemQucuehupl ohjcci ami I'lusivt v. any events saved by the associated Agent Groups 
while the A cent was in-transit. 

AgentStatus 

The AgentStatus class contains a reference to the liventPosi interface implemented by the 
Collaborator Agent's livem Queue. It also contains an Agent's unique II) and current status. 
Hence, it will serve as both an livent Queue and a status indicator. 
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AgentGrouplmpI 

The AgentGrouplmpI class derives from IVrsistentHvcniGroupImpl. Thus, it not only 
enables Agent collaboration, bul also provides reliable croup event handling. 

As a result, Agent Groups may implement different levels of persistence: Group 
membership is always written 10 persistent storage, hut queued events for in-iransit agents 
will also be saved if the Agent Group's configuration allows it. 

Occasionally, Ihe Agent Group may generate events that it directly forwards to :« member of 
the group (e.g., to "ping" ii alter it fails to arrive at a collaboration point) or others that it 
"muiticnsis" to its members (e.g., an Agent's failure to reply ti> a ping). Group members 
may also broadcast an event to the group (e.g., an Agent may inform the group that it has 
encountered an exceptional condition). 

Agent Event 

The Ageniliveiu class is the superclass of all events generated by Agents. It includes the 
Agent's unique ID. 
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CLAIMS 

What is claimed is: 

1. In a computer network including at least a first 
computer and a second computer, an apparatus for performing 
a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 

executable code; 

a protocol for transmission of the mobile agent from the 
first computer to the second computer, wherein execution of 
the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer ; and 

an itinerary containing a reference to each destination, 
computer to which the mobile agent is designated to migrate 
and a reference to a method associated with each respective 
destination computer reference, the respective method being 
invoked when the mobile agent is present on the respective 
destination computer. 

2. The apparatus of claim 1 wherein the transmission 
protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
therefrom. 

3 . The apparatus of claim 2 wherein the transmission 
protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom. - 

4. The apparatus of claim 1 wherein the task is data 
gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
completion of such data gathering. 



The apparatus of claim 1 wherein the mobile agent 
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migrates to a plurality of destination computers within the 
computer network. 

6. The apparatus of claim 1 wherein at least one 
destination computer reference is a Uniform Resource Locator. 

7. The apparatus of claim 1 wherein at least a portion of 
the executable code required for invoking the method is 
retrieved from a mobile codebase portion of the executable 
code included in the mobile agent. 

8. The apparatus of claim 7 wherein the mobile agent 
includes a reference to a home codebase located on the first 
computer, the reference being employed to retrieve required 
executable code which is not present in the mobile codebase. 

9. The apparatus of claim 8 wherein required executable 
code is sought first in the computer on which the mobile 
agent is executing, then in the mobile codebase, and finally 
on the home codebase . 

10. The apparatus of claim 8 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 
feature prevents the mobile agent from operating outside a 
scope assigned to such thread. 

11. The apparatus of claim 8 wherein the mobile agent 
further includes sub-objects. 

12 . The apparatus of claim 1 wherein a persistent local copy 
of the mobile agent is stored following receipt of the mobile 
agent, and wherein such copy is overwritten with an updated 
persistent copy following agent execution. 
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13 . In a computer network including at least a first 
computer and a second computer, a method for performing a 
task in a second computer; comprising the steps of: 

generating a mobile agent object in the first computer, 
the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; and 

executing the mobile agent in the second computer in 
accordance with an itinerary which contains a reference to 
each destination computer to which the mobile agent is 
designated to migrate and a reference to a method associated 
with each respective destination computer reference, the 
method associated with the second computer being invoked when 
the mobile agent is present on the second computer. 

14. The method of claim 13 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

15. The method of claim 14 including the further step of 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

16. The method of claim 13 wherein the task is data 
gathering, and including the further step of transmitting the 
mobile agent back to the first computer from the second 
computer following completion of such data gathering. 

17. The method of claim 13 including the further step of 
causing the mobile agent to sequentially migrate to a 
plurality of destination computers within the computer 
network. 

18. The method of claim 13 including the further step of 
employing a Uniform Resource Locator as one of the at least 
one destination computer reference. 
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19. The method of claim 13 including the further step of 
retrieving at least a portion of the executable code required 
for invoking the method from a mobile codebase portion of the 
executable code included in the mobile agent. 

20. The method of claim 19 wherein the mobile agent includes 
a reference to a home codebase located on the first computer, 
and including the further step of employing the reference to 
retrieve required executable code which is not present in the 
mobile codebase. 

21. The method of claim 20 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 
codebase, and finally on the home codebase. 

22. The method of claim 21 including the further step of 
forming a new thread in the destination computer for 
execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

23. The method of claim 21 including the further step of 
inserting sub-objects into the mobile agent. 

24. The method of claim 13 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 

25. In a computer network including at least a first 
computer and a second computer, an apparatus for performing 
a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 

executable code; 

a protocol for transmission of the mobile agent from the 
first computer to the second computer, wherein execution of 
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the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer, at least a portion of the executable code required 
for execution being retrieved from a mobile codebase portion 
of the executable code included in the mobile agent; and 

a reference to a home codebase located on the first 
computer, the reference being employed to retrieve required 
executable code which is not present in the mobile codebase. 

26. The apparatus of claim 25 wherein the transmission 
protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
therefrom. 

27. The apparatus of claim 26 wherein the transmission 
protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom. 

28. The apparatus of claim 25 wherein the task is data 
gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
completion of such data gathering. 

29. The apparatus of claim 25 wherein the mobile agent 
migrates to a plurality of destination computers within the 
computer network. 

30. The apparatus of claim 29 wherein the mobile agent 
further includes an itinerary containing a reference to each 
destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, the respective 
method being invoked when the mobile agent is present on the 
respective destination computer. 

31. The apparatus of claim 30 wherein at least one 
destination computer reference is a Uniform Resource Locator. 
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32. The apparatus of claim 25 wherein required executable 
code is sought first in the computer on which the mobile 
agent is executing, then in the mobile codebase, and finally 

on the home codebase. r 

33 . The apparatus of claim 25 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 
feature prevents the mobile agent from operating outside a 
scope assigned to such thread. 

34. The apparatus of claim 25 wherein the mobile agent 
further includes sub-objects. 

35. The apparatus of claim 30 wherein a persistent local 
copy of the mobile agent is stored following receipt of the 
mobile agent, and wherein such copy is overwritten with an 
updated persistent copy following agent execution. 

36. In a computer network including at least a first 
computer and a second computer, a method for performing a 
task in a second computer, comprising the steps of: 

generating a mobile agent object in the first computer, 
the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; 

retrieving at least a portion of the executable code 
required for invoking the method from a mobile codebase 
portion of the executable code included in the mobile agent; 

employing a reference to a home codebase located on the 
first computer to retrieve required executable code which is 
not present in the mobile codebase; and 

executing the mobile agent in the second computer such 
that the mobile agent prompts the task to be performed in the 

second computer. 



WO 98/21662 



PCTAJS97/20232 



37. The method of claim 36 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

38/ The method of claim 37 including the further step of 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

39. The method of claim 36 wherein the task is data 
gathering, and including the further step of transmitting the 
mobile agent back to the first computer from the second 
computer following completion of such data gathering. 

40. The method of claim 36 including the further step of 
causing the mobile agent to sequentially migrate to a 
plurality of destination computers within the computer 
network. 

41. The method of claim 40 wherein the mobile agent further 
includes an itinerary which contains a reference to each 
destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, and including the 
further step of invoking the method associated with, the 
respective destination computer when the mobile agent is 
present on the respective destination computer. 

42. The method of claim 41 including the further step of 
employing a Uniform Resource Locator as one of the at least 
one destination computer reference. 

43. The method of claim 36 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 
codebase, and finally on the home codebase . 

44. The method of claim 36 including the further step of 
forming a new thread in the destination computer for 
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execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

45. The method of claim 36 including the further step of 
inserting sub-objects into the mobile agent. 

46 The method of claim 41 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 
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